Multipurpose imaging and display system

ABSTRACT

A multi-purpose imaging and display system includes a display; a detector coupled to the display and having a field of view; and a filter communicating with the detector. The field of view is imaged by the detector through the filter, the filter configured to be sensitive to a first frequency spectrum, so the detector displays only objects within the field of view on the detector that emit one or more frequencies within the first frequency spectrum. The detector and filter can work together in different operational states or modes for acquiring image data of a target object under investigation. A computing device can be included to process acquired image data, and communication interfaces can be employed to achieve networking of multiple systems. A peripheral interface allows a plurality of peripheral devices to be selectively added to tailor the data acquisition and display capabilities of the imaging and display system.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/031,791 filed on Apr. 25, 2016, which is a 35 U.S.C. 371 filing ofPCT/US2014/062454 filed Oct. 27, 2014, which claims the benefit of U.S.Provisional Application No. 61/895,630 filed on Oct. 25, 2013, thecontents of which is incorporated herein by reference.

TECHNICAL FIELD

The present invention generally relates to imaging and display systems.Particularly, the present invention relates to a multipurpose imagingand display system having a detector capable of being selectivelyconverted from one imaging mode to another to image various targetfrequencies in order to acquire image data for viewing on a wearabledisplay. More particularly, the present invention relates to amultipurpose imaging and display system having a wearable display and amulti-mode detector, which provides a network communication link withother imaging and display systems to facilitate collaborativecommunication, and that provides a communication link with variousspecialized data acquisition peripherals for attachment to the displayto customize the data acquisition and display features of the system.

BACKGROUND OF THE INVENTION

Due to the continued advancements in military defense technology and themedical care field, visual identification and processing of data iscritical to support the activities of the various personnel responsiblefor performing visually intensive analytical tasks. For example, in thecase of military operations, improvements in the ability to efficientlyidentify and diagnose an injury in the field would reduce the mortalityrate of injured military personnel. In addition, because the number ofmedically trained personnel is greatly constrained, there are limitedresources that can be allocated to the screening, identification andtreatment disease in the military or civilian fields. Thus, the abilityto empower non-medical personnel to screen, identify and treat injuriesoccurring in both military and civilian fields by non-medical personnelthrough networked communication is highly desirable.

Furthermore, in addition to medical care, military personnel arerequired to fulfill a broad array of duties that requires specializedequipment. Due to the nature of such duties multiple pieces of equipmentare typically required to be carried and managed by each individual.Because of the weight, and the complexity of the equipment, which canrequire several individual modules to be coupled together with a varietyof communication cables, such equipment is significant in weight andadds to the burden placed on military personnel who are already undersubstantial physical stress in the field at times of combat.

Therefore, there is a need for a multi-purpose imaging and displaysystem that provides a display, such as a wearable display, and adetector that is convertible between two or more operating modes, toreduce the total amount of equipment needed by military and medicalpersonnel. Additionally, there is a need for a multi-purpose imaging anddisplay system having convertible operating modes, whereby in a militarycombat-based mode, the multi-purpose imaging and display system isconfigured to perform predetermined functions, such as night-vision,remote sensing, and weapon aiming are enabled; and whereby in a medicalcare mode, the system is configured to perform predetermined functions,such as combat casualty care, image guided surgery for first responders,telemedicine and the like are enabled. In addition, there is a need fora multi-purpose imaging and display system that is capable ofmonitoring, sustaining and managing injured patients when medicalassistance is unavailable, through the use of computer-based analysis ortelemedical guidance. In addition, there is a need for a multi-purposeimaging and display system that is configured to enable networkcommunication between multiple users to enable untrained individuals toprovide medical care through remote collaboration with trainedindividuals.

SUMMARY OF THE INVENTION

In a first embodiment, the present invention provides a multi-purposeimaging and display system comprising: a display; a detector coupled tosaid display, said detector having a field of view; a filter inoperative communication with said detector, such that said field of viewis imaged by said detector through said filter, said filter configuredto be sensitive to a first frequency spectrum; wherein said detectordisplays only objects within the field of view on said detector thatemit one or more frequencies within the first frequency spectrum.

In a second embodiment, the present invention provides a multi-purposeimaging display system as in the first embodiment, further comprising acomputing device coupled to said display and said detector;

In a third embodiment, the present invention provides a multi-purposeimaging display system as in either the first or second embodiment,wherein said display comprises a stereoscopic display adapted to be wornand viewed by a user.

In a fourth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, whereinsaid display is carried by a goggle system adapted to be worn by theuser.

In a fifth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, whereinsaid display comprises a display selected from the group consisting of:a head-mounted display, an optical-see through display, a head-mountedprojection display, a video see-through display, a selective occlusionsee-through head-mounted display, a retinal scanning display, aswitchable optical see-through display, and a video see-through display.

In a sixth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, whereinsaid detector comprises a detector selected from the group consistingof: an image intensifier tube, a micro-channel plate image intensifier,a thin-film image intensifier, a camera, and a 3D camera.

In a seventh fourth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said detector comprises a sensor selected from thegroup consisting of: a photodetector sensor, a charge-coupled device(CCD) sensor, a complementary metal-oxide semiconductor device sensor, aphotomultiplier tube (PMT) sensor; an avalanche photodiode (APD) sensor,a thermographic sensor, and photodiodes.

In a eighth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, furthercomprising a communication interface coupled to enable communicationwith at least one other multi-purpose imaging and display system.

In a ninth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, whereinsaid communication interface enables cloud computing.

In a tenth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, furthercomprising a communication interface coupled to enable communicationwith at least one other computers, tablet computers or cell phones.

In an eleventh embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said communication interface enables cloudcomputing.

In a twelfth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, furthercomprising a communication interface enabling cloud computing.

In a thirteenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, further comprising a peripheral interface adapted tocommunicate with one or more peripherals.

In a fourteenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is selected from the groupconsisting optical spectrometer, absorption spectrometer, fluorescencespectrometer, Raman spectrometer, Coherent anti-Stokes Ramanspectrometer, surface-enhanced Raman spectrometer, Fourier transformspectrometer, Fourier transform infrared spectrometer (FTIR), diffusereflectance spectrometer, multiplex or frequency-modulated spectrometer,X-ray spectrometer, attenuated total reflectance spectrometer, electronparamagnetic spectrometer, electron spectrometer, gamma-rayspectrometer, acoustic resonance spectrometer, auger spectrometer,cavity ring down auger spectrometer, circular dichroism augerspectrometer, cold vapour atomic fluorescence auger spectrometer,correlation spectrometer, deep-level transient spectrometer, dualpolarization interferometry, EPR spectrometer, force spectrometer,Hadron spectrometer, Baryon spectrometer, meson spectrometer, Inelasticelectron tunneling spectrometer (LETS), laser-induced breakdownspectrometer (LIBS), mass spectrometer, Mössbauer spectrometer, neutronspin echo spectrometer, photoacoustic spectrometer, photoemissionspectrometer, photothermal spectrometer, pump-probe spectrometer, Ramanoptical activity spectrometer, saturated spectrometer, scanningtunneling spectrometer, spectrophotometry, time-resolved spectrometer,time-stretch Spectrometer, thermal infrared spectrometer, ultravioletphotoelectron spectrometer (UPS), video spectrometer, vibrationalcircular dichroism spectrometer, X-ray photoelectron spectrometer (XPS).

In a fifteenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is selected from the groupconsisting of fiber microscope, handheld microscope, color microscope,reflectance microscope, fluorescence microscope, oxygen-saturationmicroscope, polarization microscope, infrared microscope, interferencemicroscope, phase contrast microscope, differential interferencecontrast microscope, hyperspectral microscope, total internal reflectionfluorescence microscope, confocal microscope, non-linear microscope,2-photon microscope, second-harmonic generation microscope,super-resolution microscope, photoacoustic microscope, structured lightmicroscope, 4Pi microscope, stimulated emission depletion microscope,stochastic optical reconstruction microscope, ultrasound microscope,and/or a combination of the aforementioned, and the like.

In a sixteenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is selected from the groupconsisting of ultrasound imager, reflectance imager, Diffuse reflectanceImager, fluorescence imager, Cerenkov imager, polarization imager,radiometric imager, oxygen saturation imager, optical coherencetomography imager, infrared imager, thermal imager, photoacousticimager, spectroscopic imager, Raman Spectroscopic imager, hyper-spectralimager, fluoroscope, gamma imager, X-ray computed tomography, endoscope,laparoscope, bronchoscope, angioscope, and an imaging catheter.

In a seventeenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more Raman spectrometers.

In an eighteenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more ultrasound imagingsystems.

In a nineteenth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more absorptionspectrometers.

In a twentieth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more of fluorescencespectrometers.

In a twenty-first embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more of vital signsensors, said vital sign sensors monitoring one or more of: temperature,blood pressure, pulse, respiratory rate, ECG, EEG, pulse oximetry, andblood glucose.

In a twenty-second embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is selected from reflectancespectrometers, diffuse reflectance spectrometers, and diffusereflectance imagers.

In a twenty-third embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is selected from in vivomicroscopes and ex vivo microscopes.

In a twenty-fourth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more hyperspectralimaging systems.

In a twenty-fifth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more tracking module.

In a twenty-sixth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said tracking module is selected from the groupconsisting of optical tracking system, electromagnetic tracking system,radio frequency tracking system, gyroscope tracking system, videotracking system, acoustic tracking system, and mechanical trackingsystem.

In a twenty-seventh embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said tracking module comprise LEDs and spectralfilters.

In a twenty-eighth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said tracking module comprises software that enabletopology sampling using a tracked handheld imaging probe or a trackedhandheld sampling probe.

In a twenty-ninth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more global positioningsystem.

In a thirtieth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more robots.

In a thirty-first embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said peripheral is one or more droid.

In a thirty-second embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, further comprising a light source.

In a thirty-third embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source includes a spectral filter.

In a thirty-fourth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source includes a white light-emittingdiode.

In a thirty-fifth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source includes a surgical light havinga plurality of individual light sources spaced apart to project lightonto an object such that a shadow cast by an intervening object and oneor more of said plurality of individual light sources is negated by atleast one other of said plurality of individual light sources.

In a thirty-sixth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source is selected from whitelight-emitting diodes and polarizers.

In a thirty-seventh embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source includes a white light source anda spectral filter filtering out a particular wavelength of light toavoid interference with an fluorescence emission wavelength.

In a thirty-eighth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source includes a laser diode and adiffuser.

In a thirty-ninth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source includes a projector and spectralfilter.

In a fortieth embodiment, the present invention provides a multi-purposeimaging display system as in any of the preceding embodiments, whereinsaid light source includes a pulsed illumination device, or may utilizefrequency modulation or pulse-duration modulation.

In a forty-first embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said detector may detect signals of a givenfrequency or spectrum, and the light source may correlate the detectedsignal with the frequency modulation and pulse-duration modulation.

In a forty-second embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said light source comprise illumination that offeradjustable components that overlap with emission spectra.

In a forty-third embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said computing device comprises memory modules thatstores educational contents.

In a forty-fourth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said memory modules that stores educationalcontents comprises memory modules that stores medical training contents.

In a forty-fifth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, wherein said memory modules that stores educationalcontents comprises memory modules that stores military trainingcontents.

In a forty-sixth embodiment, the present invention provides amulti-purpose imaging display system as in any of the precedingembodiments, where said filter selectively movable out of communicationwith said detector

In a forty-seventh embodiment, the present invention provides a methodfor visualizing educational contents, said method comprising: obtainingeducational contents from remote computers using a multi-purpose imagingand display system in accordance with any of the preceding embodiments;observing the educational contents using a multi-purpose imaging anddisplay system in accordance with any of the preceding embodiments.

In a forty-eighth embodiment, the present invention provides a methodfor capturing sending, receiving and visualizing educational contents,said method comprising: capture images as educational contents using amulti-purpose imaging and display system in accordance of with any ofthe preceding embodiments; sending images from a multi-purpose imagingand display system in accordance of with any of the precedingembodiments to another a multi-purpose imaging and display system inaccordance with any of the preceding embodiments; observing the imagesas educational contents using a multi-purpose imaging and display systemin accordance with any of the preceding embodiments.

In a forty-ninth embodiment, the present invention provides a method inaccordance with the above embodiment, further comprising: record audioas educational contents using a multi-purpose imaging and display systemin accordance with any of the preceding embodiments; sending audiorecorded from a multi-purpose imaging and display system in accordanceof with any of the preceding embodiments to another multi-purposeimaging and display system in accordance of with any of the precedingembodiments; listen to the audio as educational contents using amulti-purpose imaging and display system in accordance of with any ofthe preceding embodiments.

In a fiftieth embodiment, the present invention provides a method inaccordance with the above embodiment, a method for imaging forensicevidence, said method comprising: applying fluorescent forensic tracersto the environment and observing the environment using a multi-purposeimaging and display system.

In a fifty-first embodiment, the present invention provides amulti-purpose imaging and display system comprising: a goggle having adisplay for viewing by the eyes of one wearing the goggle; a detectorcoupled to said display, said detector having a field of view andprojecting an image of that field of view onto said display; aperipheral interface for selectively communicating with a peripheraldevice, said peripheral device providing an additional functionality.

In a fifty-second embodiment, the present invention provides amulti-purpose imaging and display system as in the fifty-firstembodiment, wherein the peripheral may be selected from any of themultitude of peripherals disclosed in any of the embodiments above.

In a fifty-third embodiment, the present invention provides amulti-purpose imaging and display system as in the fifty-first orfifty-second embodiment, wherein the additional functionality isselected from additional imaging, sensing data, and tracking data, saidtracking data relating to one or more of the location of an object inthe field of view, the location of the goggle and the location ofperipherals.

In a fifty-fourth embodiment, the present invention provides amulti-purpose imaging and display system comprising: a plurality ofgoggles, each including: a display for viewing by the eyes of onewearing the goggle, a detector coupled to said display, said detectorhaving a field of view and projecting an image within that field of viewonto said display, and a communication interface linking each of saidplurality of goggles to communicate with each other.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features and advantages of the present invention willbecome better understood with regard to the following description,appended claims, and accompanying drawings wherein:

FIG. 1 is a perspective view of a multipurpose imaging and displaysystem in accordance with the concepts of the present invention;

FIG. 2 is a schematic diagram showing the components of the multipurposeimaging and display system in accordance with the concepts of thepresent invention;

FIG. 3A is schematic diagram showing the components of a detectorprovided by the multipurpose imaging and display system when configuredwith stereoscopic imaging sensors in accordance with the concepts of thepresent invention;

FIG. 3B is a schematic diagram of an alternative configuration of thedetector, whereby multiple sensor element types are used for each of thestereoscopic imaging sensors shown in FIG. 3A in accordance with theconcepts of the present invention;

FIG. 3C is a schematic diagram of another configuration of the detector,whereby multiple sensor element types are used for each of thestereoscopic imaging sensors shown in FIG. 3A in accordance with theconcepts of the present invention;

FIG. 3D is a schematic diagram of a further configuration of thedetector, whereby multiple sensor element types are used for each of thestereoscopic imaging sensors shown in FIG. 3A in accordance with theconcepts of the present invention;

FIG. 3E is a schematic diagram of another configuration of the detector,whereby multiple sensor element types are used for each of thestereoscopic imaging sensors used for each of the stereoscopic imagingsensors shown in FIG. 3A in accordance with the concepts of the presentinvention;

FIG. 4 is a front perspective view of a shadowless surgical light inaccordance with an embodiment of this invention;

FIG. 5 is a general schematic showing the use of a spectral filter withindividual lights of the shadowless surgical light of FIG. 4,

FIG. 6 is a general schematic of a laser and laser diffuser lightsource, shown with the diffuser out of the path of the laser;

FIG. 7 is a general schematic of a laser and laser diffuser lightsource, shown with the diffuser in the path of the laser;

FIG. 8 is a graph showing a plurality of illumination pulse patternsoutput by a light source for use with the imaging and display system inaccordance with the concepts of the present invention;

FIG. 9 is a graph showing another plurality of illumination pulsepatterns output by the light source in accordance with the concepts ofthe present invention.

DETAILED DESCRIPTION OF THE INVENTION

A multi-purpose imaging and display system is generally referred to byreference numeral 100, as shown in FIG. 1 of the drawings. The system100, shown in detail in FIG. 2, includes a display 110, which maycomprise any suitable display, and, in some embodiments, is a wearabledisplay that is configured for being attached to and worn by a user 112.For example, such a wearable display 110 may be included as part of agoggle-type wearable device 114 shown in FIG. 1, which comprises awearable goggle or eye-piece frame that carries the display 110.

In one aspect, the display 110 may comprise a single display elementsuitable for providing a single, continuous display that provides asingle display surface that encompasses the totality of the user's fieldof view, or portion thereof. Alternatively, multiple separate displayelements, may be used by the display, such as a dedicated right and adedicated left display, such as in the case of a stereoscopic display,which provides an independent displays, designated as 110A and 110B(FIG. 1), to provide the field of view of each user's eye.

Furthermore, the display 110 may comprise an LCD (liquid crystaldisplay) display, an OLED (organic light emitting diode) display, aprojection display; a head-mounted display (HMD), a head-mountedprojection display (HMPD), an optical-see through display, a switchableoptical see-through display, a selective occlusion see-throughhead-mounted display, and a video see-through display. Furthermore, thedisplay 110 may comprise an augmented reality window, augmentedmonitors, a projection on the patient/projective head-mounted display,selective occlusion see-through head-mounted display, and retinalscanning display. In another aspect, the display 110 may be configuredto display any static or moving image. The display 110 may also comprisea picture-in-picture (PIP) display that can display images from multipleindependent image sources simultaneously. In one aspect, the display 110may comprise a 3D display capable of displaying 3-dimensional images. Instill another embodiment, the display 110 may be configured to provideoverlaid images of various opacity/transparency to allow simultaneousviewing of multiple images on the display 110 at one time. In yetanother embodiment, the display 110 may be at least partiallytransparent to allow a user to view the image being displayed, whileallowing the user to simultaneously see through the display 110 to alsoview the user's surrounding environment at the same time.

Coupled to the display is a detector 120, which is configured to captureany desired static or moving image data from a target of interest (TOI)130, which may comprise any desired object, such as a wound shown inFIG. 1. That is, the detector 120 includes a field of view that capturesimage data of the target of interest 103 that is within the field ofview. It should also be appreciated that the detector 120 may be used inconjunction with any suitable optical lens or optical assembly toprovide any desired field of view, working distance, resolution and zoomlevel. In one aspect, the detector 120 may comprise a camera, such as acharge-coupled device (CCD), a complementary metal-oxide semiconductordevice (CMOS), one or more photomultiplier tubes (PMT), one or moreavalanche photodiodes (APD), photodiodes, and a thermographic camera,such as an infrared detector. In addition, the detector 120 may compriseone or more image intensifier tubes, a micro-channel plate imageintensifier, and a thin-film image intensifier.

In some embodiments, the detector is a single detector 120. In oneembodiment, the detector 120 may comprise a stereoscopic detector, whichincludes multiple imaging sensors or cameras designated respectively as120A and 120B, as shown in FIG. 1, which take stereoscopic images thatcan be displayed at stereoscopic display 110 with depth perception.

In another embodiment, the detector 120 may comprise a stereoscopicdetector, which includes multiple imaging sensors or cameras designatedrespectively as 120A and 120B, as shown in FIGS. 1 and 3A, whereby eachindividual camera 120A-B includes multiple individual sensor elements.For example, the cameras 120A-B may be each configured with a first andsecond sensor element, whereby the first sensor element provides forfull-color imaging and the second sensor element provides selective orswitchable florescence imaging. Further discussion of variousconfigurations of the various sensor elements that form the cameras120-B will be discussed in detail below.

The detector 120 may be configured to perform one or more imaging modes,including but not limited to fluorescence imaging, thermal imaging,oxygen saturation imaging, hyperspectral imaging, photo acousticimaging, interference imaging, optical coherence tomography imagingdiffusing optical tomography imaging, ultrasound imaging, nuclearimaging (PET, SPECT, CT, gamma, X-ray), Cerenkov imaging, and the like.In addition, the detector 120 may also be configured to performreal-time/offline imaging, including absorption, scattering, oxygenationsaturation imaging, fluorescence imaging, fluorescence lifetime imaging,hyperspectral imaging, polarization imaging, IR thermal imaging,bioluminescence imaging, phosphorescence imaging, chemiluminescenceimaging, scintillation imaging, and the like.

In some embodiments, the display 110 and the detector 120 are coupled toa computing unit 200. The computing unit 200 may be part of a wearableversion of the system 100 or might alternatively be an externalcomputing unit 200. The computing unit 200 includes the necessaryhardware, software or combination of both to carry out the variousfunctions to be discussed. In one aspect, the computing unit 200 maycomprise a microprocessor or may comprise any other portable orstandalone computing device, such as a smartphone, capable ofcommunicating with the various components of the system 100. It shouldalso be appreciated that the computing system 200 may also include amemory unit to store various data to be discussed. In addition, thecomputing unit 200 is configured, whereby the image data acquired by thedetector 120 may be processed and transmitted by the computing unit 200in various manners to be discussed. It should also be appreciated thatthe computing unit 200 may include a local or remotely accessible memoryunit, which allows the computing unit to store and/or acquire variousprograms, algorithms, databases, and decision support systems thatenable a variety of functions to be discussed, which may be based on theimage data collected by the detector 120. In one aspect the system 100may be powered by any suitable power source, such as a portable powersource comprising one or more batteries or a plug-in type power sourcefor connection to a standard electrical wall outlet.

In operative communication with the field of view of the detector 120 isa filter 150. Accordingly, the filter 150 serves to process the lightthat travels from the target of interest (TOI) 130 before the light isreceived at the detector 120 in the form of image data. As such, thefilter 150 is configured to use any suitable technique to process theimage data collected by the field of view of the detector 120. In oneaspect, the system 100 may be configured so that filter 150 is broughtinto or out of operative communication with the detector 120, so thatthe image data collected by the field of view of the detector 120 isselectively filtered or unfiltered. In one aspect, the selectivefiltering performed by the filter 150 may be carried out by any suitablemechanism, such as an electro-mechanical mechanism, which is initiatedby any suitable switching device 151, such as a mechanical switch, orvoice command to move the filter 150. Accordingly, when the switchablefilter 150 is in operative communication with the detector 120, thesystem 100 is placed into a first mode for detecting TOIs 130 that emitfrequencies within a spectrum of frequencies defined by the physicalparameters of the filter, such as the spectrum of frequencies emittedduring the fluorescence of materials. Alternatively, when the filter 150is not in operative communication with the detector 120, the system 100is placed into a second mode for detecting TOIs 130 within anotherfrequency spectrum, such as a night vision frequency spectrum.

It should be appreciated that the filter 150 may comprise a filter wheelhaving different discrete filters of different filtering properties,which can be selectively rotated into operative alignment with thedetector 120. In addition, the filter 150 may comprise a long-passfilter, a band-pass filter, a tunable filter, a switchable filter, andthe like. In another aspect, the filter 150 may comprise an 830 nmband-pass filter.

In other embodiments, the filter 150 may be replaced by a polarizer 152and operate in the same manner with respect to the detector 120 asdiscussed above with regard to the filter 150. Furthermore, in otherembodiments the polarizer 152 may be simultaneously used together withthe filter 150, whereby the field of view of the detector 120 isprocessed by both the polarizer 152 and by the filter 150 prior todetection by the detector 120. It should also be appreciated that thepolarizer 152 may comprise a switchable polarizer that operates in thesame manner as the switchable filter 150, or may comprise a tunablepolarizer.

Accordingly, the ability to selectively filter or selectively polarizethe field of view being detected by the detector 110 embodies a“convertible” system, whereby when the detector 110 is unfiltered, it isin a first mode, which is capable of a first imaging state, such asnight vision for military use; and when the detector is placed or“converted” into its second mode, it is capable of a second imagingstate, whereby it is capable of fluorescence imaging in medicalapplications for example.

Furthermore, using the combination of the cameras 120A-B each havingmultiple imaging elements together with the selective use of the filter150 or polarizer 152 allows for a variety of modes of operation. Forexample, in FIGS. 3B-D the detector 120 is configured such that eachcamera 120A and 120B has two sensor elements 122 and 124, whereby thefirst sensor element 122 is used for a first imaging mode (or aconvertible detection mode that is switchable between among two or moreimaging modes) and the second sensor element 124 is used for a secondconvertible imaging mode, which provides selective imaging among two ormore imaging modes. Thus, in FIG. 3B, sensor element 122 of cameras120A-B are operate in a color imaging mode, while sensor elements 124 ofcameras 120A-B operate in a convertible filter mode, that can beswitched between florescence imaging with different spectralfrequencies; or between polarization imaging with different polarizationstates. In addition, FIG. 3C shows that the sensor element 122 ofcameras 120A-B is switchable between different modes of fluorescenceimaging, while sensor element 124 of cameras 120A-B are switchablebetween different modes of polarization imaging. Furthermore, FIG. 3Dshows that the sensor element 122 of cameras 120A-B is a thermographicsensor, while sensor element 124 of cameras 120A-B are switchablebetween different modes of fluorescence imaging; or switchable betweendifferent modes of polarization imaging. Additionally, FIG. 3E shows theuse of three sensor elements, whereby sensor element 124 of cameras120A-B offer a first-type of fluorescence imaging modes; sensor element122 of cameras 120A-B is offer color imaging or thermographic imaging;and the sensor element 126 of cameras 120A-B offers a second-type offluorescence imaging modes.

Coupled to the computing system 200 is a communication interface 250,which includes a suitable antenna 252 for communicating wirelessly orvia a wired connection with a communication network 260. The system 100may communicate via the communication network 260 with othermultipurpose imaging and display devices 100A-X, or any other networkedcomputer system 262, such as laptop computers, smart phones, and thelike, as shown in FIG. 1. In one aspect, the communication interface 250is embodied as a transceiver that is enabled to both transmit andreceive data via the network 260. In one aspect, the communicationinterface 250 may be configured to communicate over the network 260using any suitable method, including RF (radio frequency) signals, suchas a low-power RF signals, a wired or wireless Ethernet communication,WiFi communication, Bluetooth communication, and the like. As such, theability of multiple systems 100 to communicate with each other enables avariety of functions, which will be discussed in detail below. Thecommunication will allow one or more of sharing of detector images andimages provided by peripherals (described below) and sound and softwareeducational modules (described below).

The communication interface 250 also enables network and cloud computingfeatures to be carried out by the imaging and display system 100. In oneaspect, the communication interface 250 allows the system 100 tocommunicate with a remote storage devices on a remote network or aremote cloud computing system, generally represented by the numeral 270,as shown in FIG. 1 to allow access centralized data storage, conductfurther computing analysis, access to other software applications, andto enable record storage.

Also coupled to the computing device 200 is a peripheral interface 300.The peripheral interface may comprise a wired or wireless interface thatallows for the addition of one or more peripherals 350 to be selectivelyadded to the imaging and detection system 100. The peripherals maycomprise one or more sensors and detectors. For example, such add-onperipheral 350 may include a vital sign sensor module, that may monitorone or more of: temperature, blood pressure, pulse, respiratory rate,ECG, EEG, pulse oximetry, blood glucose, and the like. The peripheral350 may also include an ultrasound module, a spectroscopy module (e.g.Raman spectroscopy, absorption spectroscopy, and reflectancespectroscopy), a GPS (global positioning system) module, a microscopemodule (e.g. a handheld microscope, a fiber-based in-vivo microscope,and a traditional microscope), and a non-microscopic imaging module(hyperspectral imaging, photoacoustic imaging, optical coherenceimaging).

In another aspect, the peripheral 350 may comprise a probe instrument,such as a hand-held probe. As such, the hand-held probe may be used forany desired type of microscopy. In some embodiments the probe isemployed for in vivo microscopy. The probe may utilize various detectionmethods, such as color microscopy, reflectance microscopy, fluorescencemicroscopy, oxygen-saturation microscopy, polarization microscopy,infrared microscopy, interference microscopy, phase contrast microscopy,differential interference contrast microscopy, hyperspectral microscopy,total internal reflection fluorescence microscopy, confocal microscopy,non-linear microscopy, 2-photon microscopy, second-harmonic generationmicroscopy, super-resolution microscopy, photoacoustic microscopy,structured light microscopy, 4Pi microscopy, stimulated emissiondepletion microscopy, stochastic optical reconstruction microscopy,ultrasound microscopy, and/or a combination of the aforementioned, andthe like.

In another aspect, the handheld probe used as the peripheral 350 may bea higher resolution imaging device that has not reached microscopicresolution yet. In some embodiments, the non-microscopic imaging methodis selected from one or more of the following: reflectance imaging,fluorescence imaging, Cerenkov imaging, polarization imaging, ultrasoundimaging, radiometric imaging, oxygen saturation imaging, opticalcoherence tomography, infrared imaging, thermal imaging, photoacousticimaging, spectroscopic imaging, hyper-spectral imaging, fluoroscopy,gamma imaging, and X-ray computed tomography. The physical form of thehandheld probe may comprise an endoscope, a laparoscope, a bronchoscope,an angioscope, and a catheter for angiography.

In still another example, the handheld probe may be a non-imaging deviceor a sensing device, such as a fiber-based spectrophotometer. Inaddition, different spectroscopies may be realized from use of asuitable peripheral 350, such as various optical spectroscopies,absorption spectroscopy, fluorescence spectroscopy, Raman spectroscopy,Coherent anti-Stokes Raman spectroscopy (CARS), surface-enhanced Ramanspectroscopy, Fourier transform spectroscopy, Fourier transform infraredspectroscopy (FTIR), multiplex or frequency-modulated spectroscopy,X-ray spectroscopy, attenuated total reflectance spectroscopy, electronparamagnetic spectroscopy, electron spectroscopy, gamma-rayspectroscopy, acoustic resonance spectroscopy, auger spectroscopy,cavity ring down spectroscopy, circular dichroism spectroscopy, coldvapour atomic fluorescence spectroscopy, correlation spectroscopy,deep-level transient spectroscopy, dual polarization interferometry, EPRspectroscopym, force spectroscopy, Hadron spectroscopy, Baryonspectroscopy, meson spectroscopy, Inelastic electron tunnelingspectroscopy (IETS), laser-induced breakdown spectroscopy (LIES), massspectroscopy, Mössbauer spectroscopy, neutron spin echo spectroscopy,photoacoustic spectroscopy, photoemission spectroscopy, photothermalspectroscopy, pump-probe spectroscopy, Raman optical activityspectroscopy, saturated spectroscopy, scanning tunneling spectroscopy,spectrophotometry, time-resolved spectroscopy, time-stretchSpectroscopy, thermal infrared spectroscopy, ultraviolet photoelectronspectroscopy (UPS), video spectroscopy, vibrational circular dichroismspectroscopy, X-ray photoelectron spectroscopy (XPS), or a combinationof the aforementioned.

In other embodiments, the peripheral 350 is selected from robots, droidsand global positioning systems.

Tracking and Registration of Multiple Images for Display

In some embodiments, the system 100 includes a tracking module, whichcan be considered another peripheral 350, and includes software suitablefor tracking the spatial location of the detector 120 (or 120A, 120B)and the location of peripherals 350, such as imaging cameras and probes,and registering these locations relative to the image(s) of the detector120 or detectors 120A, 120B (in stereoscopic modalities). Reference todetector 120 herein will also be understood to be equally applicable tothe stereoscopic modalities of those systems 100 employing detectors120A and 120B. Thus, the corresponding imaging and sensing informationobtained from the peripheral 350 can be correlated with the field ofview imaged by the detector 120 of the multipurpose imaging and displaysystem 100. That is, the system 100 may be programmed to utilize imagetracking and registration techniques to allow for the overlay ofmultiple images acquired directly by the detector 120 of the system 100with those images acquired by peripheral image detectors, such ashand-held microscopy probes, or the like. In some embodiments, thetracking module can also track and register the location of othernon-peripheral elements, such as the tools being employed by military ormedical personnel. For example, the location of scalpels or clamps orstents or other elements of a medical operation could be tracked andregistered with the images. It should be appreciated that the softwareenabling such tracking and registration features may be provided from aremote computer system to the system 100 via the network 260 or storedon any peripheral attached to the peripheral interface 300.Specifically, tracking techniques utilized by the system 100 obtain theposition of a patient to be treated using the system 100, the system 100itself comprising the wearable display 114, and the handheld imagingperipheral 350 coupled to the peripheral interface 300.

The tracking functions may be carried out using optical tracking ormagnetic tracking devices that are employed as a peripheral 350. Ifoptical tracking is used, active markers such as LEDs may be attached todetector 120, the imaging or sensing probe employed as anotherperipheral 350, and the patient or other desired object, to locate theirlocations, respectively. NDI Optotrak Certus system is an example ofoptical tracking systems that may be used for this embodiment.Commercially available optical tracking systems may consist of CCDcameras and sequentially illuminated infrared (IR) LEDs, and can beeasily integrated as a peripheral 350 into the wearable imaging anddisplay device 100. Alternatively, one may use a videometric system toestimate patient pose (or object positioning) and instrument orientationby identification of passive markers in video-image sequences.

In one aspect, optical tracking using NDI Optotrak Certus may beincorporated as a peripheral 350 to provide tracking, whereby lightemitting diodes (LED) are attached to the wearable device 100 thatcarries the detector 120, and imaging module as another peripheral 350,such as ultrasound and hand-held microscopy probes and patients. Assuch, the LEDs attached to the detector 120, hand-held probe as aperipheral 350, and patients are tracked by the NDI Optotrak Certussystem.

In another embodiment, a novel infrared optical tracking method may beutilized by the system 100. As such, the wavelength of the opticalemitters for tracking purposes (such as LEDs) attached to the patient,wearable imaging and display system 100, and intraoperative imagingperipheral 350 may be different wavelengths from the wavelengthsdetected by the detector 120, and imaging peripheral 350. Methods, suchas spectral filtering may be used to facilitate the separation ofwavelengths between the optical emitter from the tracking system and thedetection of the detector 120, and imaging peripheral 350. Frequencymodulation may also be used to separate the signal from the trackingoptical emitters from the signal of interest of the detector 120, andimaging peripheral 350.

In another example, gyroscopic tracking in combination with videotracking may be performed using the module 350.

If electromagnetic tracking is used, the peripheral 350 may incorporatesmall coils or similar electromagnetic field sensors and multipleposition measurement devices. The electromagnetic field sensors may beattached to detector 120, the imaging or sensing probe employed asanother peripheral 350 and the patients, to locate their locations,respectively.

Alternatively, the tracking functions may be carried out using fiducialmarkers, such as LEDs, attached to (a) the patient to be treated or anobject to be acted upon or observed (in the instance of non-medicalapplications), (b) the wearable imaging and display device 100, and (c)the peripheral 350. Through the use of fiducial markers, images of thesame subject produced with multiple distinct imaging systems—forexample, the detector 120 as a first imaging system, and any desiredperipheral 350 that generates a second image as the second imagingsystem—may be correlated by placing fiducial markers in the area imagedby both systems. Appropriate software correlates the two images, and inthe case of the present invention, permits viewing of the two (or more)images overlaid together or in a picture-in-picture format.

With the position obtained using the tracking techniques described,enabled by tracking systems as a peripheral 350, registration, oralignment, of the different images obtained by the imaging and displaysystem 100 and the handheld imaging probe employed as another peripheral350 is performed by using transformation matrices between the objectbeing imaged by the detector 120 (detector image space) and images andlocations of the peripherals 350 (peripheral image space) can becalculated. Specifically, the image registration process is carried outsuch that the image captured by detector 120 and peripheral locationsand images can be registered together as a single image. As a result,the co-registered images from the detector 120 of the wearable system100 and the image peripheral 350 can be displayed in the wearabledisplay in an overlaid and aligned manner.

It should also be appreciated that in addition to the trackingtechniques described above, other tracking techniques may be used, suchas radio frequency tracking, gyroscope tracking, video tracking (patternrecognition), acoustic tracking, mechanical tracking, and/or acombination thereof. In addition, the tracking method employed by themodule 350 may utilize rigid body, flexible body or digitizer methods.

It should also be appreciated that in addition to the registrationtechniques discussed above, other registration techniques may be used,such as point-based registration, surface-based registration, and/or acombination thereof. The registration may comprise eitherintensity-based or feature-based registration. The transformation modelsused may comprise linear transformation, or non-rigid/elastictransformation. Spatial or frequency domain methods may be used, as wellas automatic or interactive methods.

To sample the topology of the object/physical space in the field of view(or the target of interest), digitizers (such as the device from NDI)may be used to sample the points in physical space. Alternatively,topology acquisition systems, such as a 3D scanner may be used tocapture the 3D topology, which may facilitate image registration.

In some embodiments, a handheld probe employed as a peripheral module350 may serve dual purposes: serving as stylus/digitizer for samplingtopology; and serving as imaging or sensing probe. Specifically, thehandheld probe may have optical emitters such as LEDs attached to it,which will allow location of the tip of the handheld probe with the helpof the optical tracking system. Alternatively, the position of the tipcan be obtained by tracking the electromagnetic sensors attached to thehandheld probe using a magnetic tracking system. When the probe areswiped across different points on the surface of the organs, a 3D pointcloud can be established, based on the locations of the tips of handheldprobe (tip is considered to be just in contact with organs). In thisway, the imaging handheld probe also enables similar functionality tosample topology as the non-imaging stylus/digitizer traditionallyemployed in tracking systems.

In another aspect, a tracking system employed as a peripheral module 350may track the positions of an imaging peripheral (e.g., a hand-heldmicroscopy probe peripheral) also employed as a peripheral module 350,and register the image taken with the imaging peripheral with the imagegenerated by the detector 120, and display it in the display 110. Assuch, the images detected by the imaging peripherals, such as aultrasound probe may then be overlaid with images collected, such asfluorescence images, by the detector 120 of the imaging and displaysystem 100 for presentation on the display 110. The registration ofmultiple images on the display 110 may be achieved using any suitabletechnology, including point-based registration, surface-basedregistration, intensity-based, feature-based registration, and/or acombination of both. The transformation models used may comprise lineartransformation, or non-rigid/elastic transformation. Spatial orfrequency domain methods may be used, as well as automatic orinteractive methods. For example, fiducial markers, such as LEDs, may beused to facilitate point-based registration. In another example, ifsurface topology or profile is available, the surface-based registrationcan also be used. In yet another example, the registration may also bebased on pattern recognition or feature-based recognition.

Thus, by combining the functionality of the communication interface 250and the peripheral interface 300, the system 100 is enabled to providemultiple functions. One or more peripherals of a multitude of types,including those mentioned above can be selectively coupled to thedisplay system 100, as needed for providing the system 100 with adesired functionality. If imaging from a probe is needed in a givenapplication, for example for in vivo imaging of a patient, a probe as aperipheral 350 can be coupled to the display system 100 at the interface250 so that the display system 100 would then have the ability todisplay the image gathered from the probe. As per the trackingdisclosure above, this image could be overlaid onto the image of thepatient gathered by the detector 120, placing the in vivo image of theprobe employed as a peripheral 350 at the proper location on the imageof the patient.

In another aspect, a co-registration of a 4 sensor setup between colorand fluorescence imaging, whereby vertical and horizontal disparitiesare correlated. In particular, this example describes the manner inwhich a 4 camera setup is used to register intraoperative color imagingto intraoperative fluorescence imaging.

In another embodiment, stereoscopic fluorescence images captured by 2fluorescence cameras and stereoscopic color images captured by 2 colorcameras can be registered together. Both sets of images were placed intoside-by-side frames, and the fluorescent side-by-side frame was overlaidonto the anatomical frame by the computing module and sent to thedisplay. For high registration accuracy, we measure the verticaldistance from the center of the filtered cameras for fluorescence to thecenter of the unfiltered color camera as well as the horizontal baselinedistance between two filtered or unfiltered cameras. From thisinformation, a correction metric, D_(V), was determined from theequation:

$\frac{L_{H}}{L_{V}} = \frac{D_{H}}{D_{V}}$where L is the measured baseline disparity between cameras in either thehorizontal (II) or vertical (V) direction, and D_(H) is the horizontalpixel disparity between common points in the left and right fluorescentimages. The points used to calculate D_(H) were the peak fluorescentpoints; if more than one peak existed, one was chosen for thecalculation. The fluorescent frames were then shifted up by thecalculated correction metric so that, after calibration, the fluorescentimage was aligned to the corresponding color image.

In addition, GPS and wireless communication between multiple imaging anddisplay systems 100A-X can be integrated, such that information relevantto military or medical environments is labeled with GPS data. Thus, inone embodiment, information acquired by each system 100A-X can also betransmitted or received wirelessly, to guide battle or medicalinterventions. Using telemedicine functionality of the system 100,medical operations can be performed by first responders using the system100 under the guidance of medical practitioners that are locatedremotely but who are also using the system 100. It should be appreciatedthat the systems 100A-X may also communicate with any other suitablecomputing device, such as a tablet, mobile smart phone, or the like.

In addition, the system 100 may include an illumination or light source400 to illuminate the field of view used to image the target object ofinterest 130 being imaged by the detector 120. It should also beappreciated that the light source 400 is configured to deliver a lighthaving the appropriate intensity and frequency spectrum that iscompatible with the particular imaging being conducted with the detector120, with or without the filter/polarizer 150,152. For example, it maybe necessary to have a light source 400 that emits a first frequencyspectrum for use in a first imaging mode, such as a night vision imagingmode, and that emits a second frequency spectrum for use in a secondimaging mode, such as a fluorescence imaging mode. In one aspect, thelight source 400 may be coupled to the computing device 200 forautomated control over the functions provided by the light source 400,or may be unattached from the computing device 200 and operated manuallyby the user of the system 100.

It should also be appreciated that the light source 400 may servedifferent purposes in both the military environment and the medicalenvironment. For example, the light source 400 may be used in militaryapplications for enabling weapon aiming, for guiding laser guidedweaponry, or for night vision. Furthermore, upon conversion of thedetector 120 by removal or the filter/polarizer 150,152 or by selectingthe necessary filter/polarizer 150,152 the illumination of the lightsource 400 may be used for florescence imaging, optical imaging,photodynamic therapy, laser surgery, sterilization, and the like. Itshould also be appreciated that multiple light sources 400 may be used.

It should also be appreciated that the light source 400 may comprise alaser light; a light emitting diode (LED), such as a white LED; anincandescent light; a projector lamp; an arc-lamp, such as xenon, xenonmercury, or metal halide lamp; as well as coherent or in-coherent lightsources.

The light source 400 may also comprise a digital (LED-based) projectorlamp, and additionally the light source may project spatial frequenciesfor patterned illumination. In addition, the light source 400 may emit acontinuous or pulsed output, and may generate light that is within anydesired spectral window of electromagnetic waves.

It should also be appreciated that the light source 400 may also includea light diffuser.

In some embodiments, particularly when it is desired to observe afluorescence emission spectra from the object being illuminated andobserve through the imaging and display system 100, the light source 400selectively shines through a spectral filter 402 (FIG. 2) that blocksthe wavelength of the emission spectra to be observed, such that thelight source 400 does not interfere with the observance of that emittedwavelength. For example, if the object is to be observed for fluoresceat a certain wavelength, the spectral filter 402 would be chosen toblock that wavelength from the light source so that the light sourcedoes not interfere with the observance of the emitted fluorescence. Insome such embodiments, the light source is a white light source thusproviding a broad spectrum, and the spectral filter is appropriatelychosen based on the emission spectra to be observed. In someembodiments, the light source is one or more white light emitting diodes(LED). In some embodiments, the individual light sources are white lightemitting diodes (LED) that are filtered by a 775 nm low-pass filter. Inanother embodiment, the low-pass filter may be replaced with apolarizer, or may be used in conjunction with the filter the lightsource shines through a spectral filter.

With reference to FIGS. 4 and 5, in another embodiment, the light source400 may comprise a shadow-less light 404 which is desirable for useduring surgery (i.e. a surgical light). The shadow-less light 404includes a plurality of individual light sources 406 spaced apart in asupport 407 to project light onto an object such that a shadow cast byan intervening object and one or more of the plurality of individuallight sources is negated by at least one other of the plurality ofindividual light sources. For example, the shadow-less light 404 can bea surgical light and a surgeon my interpose a hand and arm between theshadow-less light 404 and the patient and thus certain individual lightsources would tend to cast a shadow onto the patient but for the factthat other light sources will not have the hand/arm of the surgeoninterposed between the shadow-less light source and the surgeon suchthat those lights will negate the shadow, thus leading to shadow-lesslighting. As known, the support 407 is on the end of a swing arm 410, ora goose neck or other connection providing the ability to position thelight 404 as desired. This concept of a shadowless light source isseparately at invention herein outside of the imaging and display system100.

In some embodiments, particularly when it is desired to observe anemission spectra from the object, the individual light sources 406 ofthe shadow-less light 404 selectively shine through a spectral filter408 (FIG. 5) that blocks the wavelength of the emission spectra to beobserved, such that the shadow-less light source does not interfere withthe observance of that emitted wavelength. In some embodiments, theindividual light sources are white light emitting diodes (LED). In someembodiments, the individual light sources are white light emittingdiodes (LED) that are filtered by a 775 nm low-pass filter. In anotherembodiment, the low-pass filter may be replaced with a polarizer, or maybe used in conjunction with the filter.

In a particular embodiment, the light source 400 is afluorescence-friendly shadow-less surgical light, which can providewhite light surgical illumination and florescence illumination withoutleaking frequencies overlapping with fluorescence emission. Thisshadow-less light offers both well-rendered surgical illumination (lookslike white light to naked light) and fluorescence excitation at the sametime. In one embodiment, such light source comprises a plurality ofwhite light emitting diodes (LED) coupled with Notch Filters that areOptical Filters that selectively reject a portion of the spectrum, whiletransmitting all other wavelengths. With the notch the frequenciesoverlapping with fluorescence emission, which are emitted by white LEDs,are rejected. It should be appreciated that in some cases edge filterscan be used to achieve similar results in blocking the frequenciesoverlapping with fluorescence emission. In one example, the shadow-lesslight source comprises a plurality of white light emitting diodes (LED)that is filtered by a 775 nm low-pass filter. It should be appreciatedthat thin films or other devices may play similar role as notch filtersor edge filters in the fluorescence-friendly shadow-less surgical light.In one aspect, the shadow-less light 400 may comprise an array of whitelamps with edge filters or notch filters. In another embodiment, thespectral filters may be replaced with polarizers, or may be used inconjunction with the filters.

In some embodiments, the light source is a traditional projector (lampbased) or digital projector (LED-based) selectively used in conjunctionwith spectral filters or polarizers (as described with other lightsources). The projector can also selectively project spatial frequencies(i.e., provide patterned illumination). The spectral filters can be in afilter wheel as already described. The projector beneficially provide awell-defined illumination area. The projector can be set to project anydesired wavelength of light and can project without brighter and dimmerareas (i.e., provides consistent light).

With reference to FIGS. 6 and 7, in another embodiment, the light source400 comprises a laser diode 412 and a diffuser 414 movable to beselectively interposed between the laser diode 412 and the object.Without the diffuser 414 interposed, the laser diode 412 simply shines afocused beam of light, while, with the diffuser 414 interposed, thelaser shines over a greater surface area and is suitable for generalillumination. In some embodiments this can allow for switching betweenlaser aiming and night vision (with diffuser out of light path) orfluorescence-guided treatment (with diffuser in light path). Inaddition, the laser diode with diffuser 400 may also use a filter. Inaddition, the laser diode 400 may also be pulsed, or frequency modulatedto reduce the average amount of light energy delivered.

As seen in FIGS. 8 and 9, in some embodiments, the light source 400 maycomprise a pulsed light source, or may utilize frequency modulation orpulse-duration modulation. In one aspect, the detector 120 may detectsignals of a given frequency or spectrum, and the light source 400 maycorrelate the detected signal with the frequency modulation andpulse-duration modulation. In one aspect, the light source 400 maymodulate the emitted light using an electro-optic modulator, opticalchopper, or the like. Alternatively, if the light source 400 comprisesone or more light emitting diodes (LED) the light source 400 may operateto adjust the intensity of light being output by adjusting the frequencyof the AC (alternating current) that is supplied to power the LEDs.

Specifically, as shown in FIG. 8, the DC component of the light source400 detected by the goggle system 100 are the fluorescence image type-1,and the AC component of the light detected by the goggle system 100 areflorescence image type-2. The goggle system 100 may use a 2-camera setupor a 4-camera setup. The goggle system 100 is configured to detect thesignals, correlated with the frequency modulation or pulse-durationmodulation. Various ways of modulating the light may be used, such as anelectro-optic modulator, an optical chopper, or the like. If LEDs areused, the illumination output by the light source 400 can be modulatedby supplying AC current of desirable frequency through the LEDs. Alock-in amplifier may be used by the system 100. It should beappreciated that light bulbs, lamps, laser diodes, lasers or the likecould be used instead of LED based light source 400.

Furthermore, as shown in FIG. 9, the frequency component of the lightsource 400 designated f1, which is detected by the goggle system 100will be the fluorescence image type-1, and the frequency component ofthe light designated f2 that is detected by the goggle system 100 is thefluorescence image type-2. The goggle system 100 may use a 2-camerasetup or 4-camera setup, and the goggle system 100 will detect thesignals, correlated with the frequency modulation or pulse-durationmodulation. Possible ways of modulating the light may compriseelectro-optic modulator, optical chopper, or the like. In addition, ifLEDs are used, the illumination output by the light source 400 can bemodulated by supplying AC current of desirable frequency through theLEDs. In addition, a lock-in amplifier may be used by the system 100. Itshould be appreciated that light bulbs, lamps, laser diodes, lasers orthe like could be used instead of LED based light source 400.

It is also contemplated that the system 100 includes a microphone 480and a speaker 490 to enable verbal communication between the varioussystems 100A-X and other computer systems (i.e. tablet computers, smartphones, desktop computers), and the like.

Thus, with the structural arrangement of the various components of themultipurpose imaging and display system 100 set forth above, thefollowing discussion will present various embodiments of the system 100for executing specific functions.

The system 100 may be configured whereby the filter 150 is placed in afirst state, such as in military applications, so that it is moved outof the field of view of the detector 120 (i.e. filter not used) toprovide night vision imaging of the target 130. Alternatively, thefilter 150 may be placed in a second state, such as in medicalapplications, so that the filter 150 is in the field of view of thedetector 120 (i.e. filter is used) to enable fluorescence imaging of thetarget 130. In addition, any suitable contrast agent, such asindocyanine green (ICG) may be used that is compatible with thefrequency spectrum for which the filter 150 is sensitive to facilitatethe fluorescence detection enabled by the filter 150. As previouslydiscussed, any suitable filter 150 that is sensitive to a desiredspectrum of frequencies may be used so that only the particular targets130 emitting the desired frequencies are imaged. It should beappreciated that either autofluorescence or extrinsic fluorescence fromcontrast agents could be detected. In addition, such fluorescenceimaging has application in medical applications such as intraoperativeimaging, wound assessment, but also in military applications to carryout the detection of biological and chemical warfare.

The system 100, as previously discussed by use the polarizer 152 in aconvertible or selective manner, such that when polarization is invokedin a first state, the detector 120 provides polarization-gated imaging,polarization difference imaging, spectral-difference polarizationimaging, Muellar matrix imaging for both military and medicalapplications.

For example, the system 100 may also use traditional division of timetechniques, as well as tunable liquid crystal polarization filters ordivision of focal plane technology (e.g. Moxtek micropolarizer arrays).

As previously discussed, the detector 120 provided by the system 100 mayalso comprise a thermal imaging sensor, which can be used for both nightvision and thermal vision. As such, vascularity, micro-circulation,ischemia can be assessed based on the thermographic images collected bythe system 100. In one aspect, the detector 120 may comprise a FLIRCompact A-Series LWIR thermal cameral. In one aspect, the thermalimaging sensor comprising the detector 120 may comprise a cooledinfrared image detector or an un-cooled infrared image detector.

The system 100 may also be used to perform hyperspectral imaging forboth remote sensing and intelligence gathering in military fields, andvarious medical applications. Furthermore, such hyperspectral imaging isachieved by using a tunable filter 150 or spectrophotometer employed asa peripheral 350 that is configured to be sensitive to the spectrumsbeing imaged.

It should be appreciated that the system 100 may be configured so thatthe detector 120 and the filter 150 selected allows near-infrared (NIR),thermal, and hyperspectral imaging to be performed by the same system100. The selective employment of different peripherals 350 offeradditional capabilities to system 100.

The system 100 may also be used to detect biohazard agents, such asviruses, bacteria or any other pathogens or any chemical warfare agents.Tracer or contrast agents may be applied to highlight the biohazardagents. Possible contrast agents include, but are not limited to:fluorescent agents, photosensitizers, nanoparticles, peptides and theirconjugates, antibodies and their conjugates, small molecules, and thelike.

The signal emitted by the contrast agents (such as fluorescence) can bedetected by the system 100. In addition, through employments ofdifferent peripherals 350, additional capabilities can be provided tofacilitate the biohazard detection. For instance, hyperspectral imagingcan be used as a peripheral 350. Devices such as absorptionspectrometer, fluorescence spectrometer, diffuse reflectancespectrometer, Raman spectrometer or surface enhance Raman spectrometercan be used as peripherals 350 to provide additional information asappropriate.

It should be appreciated that the system 100 still has the capacity tooffer night vision, or medical imaging guidance. Different imaging orsensing devices may be employed as peripherals 350 to achieve differentpurposes.

As previously discussed, each imaging and display system 100 includesthe detector 150 and a communication interface 250, which allows aplurality of systems 100A-X to communicate various data with one anotherand/or with one or more remote computing devices. It should beappreciated that the system 100 may be configured to form ad-hocnetworks between each one of the individual systems 100A-X, or may beconfigured to join any exiting wireless communication network, such as acellular data network, radio-frequency communication, wireless LAN,wireless PAN, WiFi or Bluetooth network for example. As previouslydiscussed, each system 100 has the ability to be a sender of data and arecipient of data. As such, the network of systems 100 may be used forboth military/defense and medical purposes.

In one embodiment, the detector 120 of one system 100 may capture imageor video data that is transferred over the network to one or more othersystems 100A-X or any other computing device (i.e. tablet, computer,smartphone) that are connected to the communication network. Such imagetransfer may occur simultaneously between the systems 100A-X inreal-time or in near real-time. The real-time or near real-timetransmission of image or video data, such as viewing an injured personin the field, from one system 100 may be used by recipients of the imageor video data at one or more other users of the system 100, or any otherusers of other computer systems connected to the network, in order toanalyze and provide medical guidance to based on the transferred images.In addition, such networked systems 100 allow the point-of-view orfield-of-view of the system 100 at which the image originates to berelayed to the other network systems 100, to facilitate medicaltraining, diagnosis, and treatment. As a result, the point of view orfield of view of one system 100 can be presented to other networkedsystems 100 or computing systems.

In addition, the network of systems 100 may also be used to enable thevisualization of educational content, including but not limited tomedical training, intelligence, and military training and the like.

When the system 100 is configured with a GPS peripheral 350, the system100 is able to provide navigational information. As such, the system 100may be able to report the location of the device 100, communicate thelocation to another remote location over the communication network towhich the system 100 is connected. Furthermore, all navigationalinformation can be used by the system 100 to tag all data that isgathered by the system 100, such as images collected for example.

The system 100 may also include microscopic imaging features. In oneaspect, the detector 120 may include the necessary optics to providemicroscopic imaging. In one aspect, the detector 120 may have built-inoptics to conduct microscopic imaging or may have interchangeableoptical components for microscopic imaging. In another aspect, themicroscope may be provided as a separate peripheral 350 that is coupledto the peripheral interface 300, such that the image supplied by themicroscope may be presented on the display or communicated through thenetwork other systems 100 and networked devices, as previouslydiscussed.

The system 100 may also be utilized to facilitate telemedicinefunctions. For example, the system 100 allows a surgeon in remote areasto perform surgery under the supervision of an expert surgeon. Thesystem 100 can also assist combat medics to perform procedures under theremote guidance of a clinician. Additionally, the system 100 can alsoload the location-specific patient/military information to another sitewhere the data can be stored and organized; the system 100 can uploadpatient information for data storage, medical record keeping, diagnosis,telemedical consultation, epidemic tracking and epidemiology. Othersystems 100 may communicate via the network simultaneously.

A central networked computer unit may maintain a database of allrecords, such as medical records, from where reminders can be sent toclinician/technicians for point-of-care check-up or follow-up withpatients. In one embodiment, the system 100 can enable telesurgery wherea remote medical clinician may control a local surgical-robot using thenetwork to perform surgery from a remote site.

It should also be appreciated that the system 100 may be used achieve avariety of functions using the imaging, display, and collaborativecommunications features of the present invention. As such, the followingdiscussion presents a variety of applications demonstrating thebeneficial aspects of convertible operating mode provided by the system100, whereby examples are provided in which the system 100 is placed ina military operating mode or a medical operating mode. Moreover, whilethe examples are descriptive of a variety of applications of the system100, such examples are not limiting. In particular, the system 100 maybe used to image, monitor and treat injuries and wounds using thecollaboration between a user of the system and remote medically-trainedpersonnel that are in collaborative communication with each other.Similarly, the system 100 may also be used to perform medicalinterventions with limited resources/military constraints beforeevacuation, and to guide and enable first-responders to perform medicaltasks, including surgeries, and wound debridement. The ability formultiple users of the system 100 to collaborate also allows the users toprovide medical assistance and advisement to one another. Additionally,the system 100 allows the users to guide a triage of large numbers ofcasualties, as well as staged treatment in the field; enabletelemedicine that allows for 2-way telemedical collaboration betweenfirst responders and medical advisors; enable remote triage, monitoringand management of casualties, aided by experts; provide medical decisionsupport with automated algorithms in conjunction with telemedicaladvisement from a remote site; guide treatment of hemorrhage, detectionof vascular collapse and significant tissue damage due to perfusiondeficits; facilitate diagnosis of brain and spinal cord injury; monitorand guide treatment to reduce secondary damage such asischemia/perfusion injury after trauma; offer guidance to decontaminate,debride, protect and stabilize hard and soft tissue wounds; offerdiagnostic and prognostic algorithms for non-medical and medicalprofessionals; guide the assessment and treatment of dental injuries;guide the assessment and treatment of maxillofacial trauma repair, aswell as orthopedic injuries.

It should also be appreciated that the system 100 may be used tofacilitate medical biological defense; provide medical countermeasuresfor biological warfare agents; guide prophylaxis and pretreatment toprevent casualties; to allow the identification and diagnosis ofbiological agents, such as infectious agents including, but not limitedto: anthrax, plague, Glanders, Ebola, and Marburg viruses, as well asthe Venezuelan, western and eastern equine encephalitis viruses; and thepoxvirus models of variola virus. Examples of toxins detectable by thesystem 100 may include those derived from plants, such as Ricin, andthose derived from bacteria, such as staphylococcal enterotoxins andbotulinum.

The system 100 may also be used to facilitate medical chemical defense;provide diagnostic and prognostic indicators for chemical warfare agentcasualties; and provide detection of chemical agents that may includevesicant or blister agents (e.g. sulfur mustard), blood agents (e.g.cyanide), respiratory agents (e.g. phosgene) and nerve agents (e.g. GAor Tabun, GB or Sarin, GD or Soman, and VX).

In addition, the system 100 may also be used to characterize themechanisms of vesicant agent pathology to identify medicalcountermeasures against vesicant agents; provide rapid and accurateanalysis of human tissues and body fluids for detection of chemicalwarfare agent exposures.

The system 100 is also configured to serve as a training platform formilitary and medical purposes, whereby the system 100 utilizes augmentedreality/virtual reality for training procedures and for combat casualtytraining for soldiers and combat medics.

Furthermore, the system 100 also provides biomonitoring and telemedicalassistance in hospitals, the home and in the field.

In addition, the system 100 may also be integrated with medical robotsand telesurgical applications.

In one aspect, the memory unit of the system 100 may store software tosimulate a medical or military training procedure that is based onvirtual reality or augmented reality. Two dimensional or threedimensional images or video may be stored at the memory unit of thesystem 100, or in a remote server coupled to the network to which thesystem 100 is connected, which enables visualization of educationalcontent, such as medical training, intelligence training, and militarytraining.

In another aspect, the training software may include audio-visualtraining tutorials with step-by-step instructions for carrying outparticular procedures via the display 110. In addition, the tutorialsmay outline tasks for how to prepare for an examination, how to operateultrasound, and how to position a patient. Ultrasound techniques, suchas how to manipulate the ultrasound probe and use the keyboard functionsof the ultrasound system may be included. The tutorials may also includevarious examination protocols; reference anatomy information withreference ultrasound images; procedures for how to make a diagnosis; andprocedures for how to treat patients and treatment tutorials may beincluded. With networked systems 100, the training can be augmented byhaving educators networked in by having their own system 100 to interactwith students with their own system 100. This is particularly adapted touse of a goggle system 100.

In another embodiment, the system 100 may be used to detect blood or anyother target 130 based on intrinsic absorption, auto-fluorescence, orextrinsic fluorescence and chemiluminescence. In one aspect, a mixtureof predetermined fluorescence tracers, such as Hemascein for example,may be used to spray an area or region being investigated, which reactswith a desired target of interest 130 to cause the target 130 tofluoresce so as to be detected by the system 100, as previouslydiscussed. In this case, a 475 nm band-pass filter 150 may be used withthe Hemascein to detect blood as the target of interest (TOI) 130 usingthe system. It should be appreciated that the system 100 may be used todetect other forensic evidence. The networking feature of system 100 maybe used as appropriate to enable communication between systems 100A-X.

In addition, through employments of different peripherals 350,additional capabilities can be provided to facilitate the forensicdetection. For instance, hyperspectral imaging can be used as aperipheral 350. Devices such as absorption spectrometer, fluorescencespectrometer, diffuse reflectance spectrometer, Raman spectrometer orsurface enhance Raman spectrometer can be used as peripherals 350 toprovide additional information as appropriate.

It should be appreciated that the system 100 still has the capacity tooffer night vision. Different imaging or sensing devices may be employedas peripherals 350 to achieve different purposes.

In one aspect, the light source 400 may have components that overlapwith emission spectra, referred to as bleed-through components. Thebleed-through components can be tunable to achieve desirable level ofbackground. For example, in the case of indocyanine green dye, if theemission filter is an 820 nm long-pass filter, the component ofillumination is >820 nm will pass through the emission filter (ifemission filter is 820 nm long pass filter) and become the background,or the bleed-through component. The illumination could have both 780 nmLEDs for fluorescence excitation and 830 nm LEDs for bleed-through. Bychanging the intensity of the 830 nm LEDs, the level of background canbe adjusted, which is useful in a variety of situations.

Based on the foregoing, the advantages of the present invention arereadily apparent. The main advantage of this invention is to provide aconvertible system, which has application in both military and medicalfields. Still another advantage of the present invention is that medicalapplications can be enabled in part based on existing defense technologyplatforms. Yet another advantage of the present invention is that onlyone system is needed for use in both military and medical fields, suchthat same equipment used for military uses can be used to provideenhanced medical care, without increasing the amount of equipmentneeded. Still another advantage of the present invention is that diversetasks can be performed with one system, such as to diagnose, monitor,provide wound treatment, identify infectious diseases and spinalcord/brain injury, and the like. Another advantage of the presentinvention is that triage and treatment can be guided with automatedmechanism and/or remote telemedical guidance, such that treatment fromnon-medical professionals can be facilitated. An additional advantage ofthe present invention is that countermeasures against biological andchemical warfare can be facilitated within the system without additionalequipment. Still another advantage of the present invention is thatfirst responders can use the system to perform complex tasks, provideself-aid and aid to others, while empowering medical personnel to domore within military constraints. Another advantage of the presentinvention is that the system is lightweight, easily transportable,battery-operated and self-contained. Yet another advantage of thepresent invention is that the system provides microscopic imagingcapability. An other advantage of the present invention is that GPS andremote communication are provided by the system to facilitate warfareand medical management.

Thus, it can be seen that the objects of the present invention have beensatisfied by the structure and its method for use presented above. Whilein accordance with the Patent Statutes, only the best mode and preferredembodiment has been presented and described in detail, it is to beunderstood that the present invention is not limited thereto or thereby.Accordingly, for an appreciation of the true scope and breadth of theinvention, reference should be made to the following claims.

What is claimed is:
 1. A system for capturing images of a target ofinterest associated with a patient in real-time and simultaneouslydisplaying the captured images in real-time to a user that is engagingthe target of interest associated with the patient, comprising: awearable display that is worn on a head of the user as the user engagesthe target of interest associated with the patient and is configured todisplay in real-time a portion field of view to the user as the userengages the target of interest associated with the patient via thewearable display simultaneously as images of the target of interestassociated with the patient are captured and streamed in real-time tothe wearable display, wherein the portion field of view that is therebydisplayed to the user by the wearable display is less than a total fieldof view of the user; a detector that is coupled to the wearable displayand is configured to capture an imaging field of view of the target ofinterest associated with the patient in real-time as the user engagesthe target of interest associated with the patient, wherein real-time iswhen the imaging field of view of the target of interest associated withthe patient is captured as the user engages the target of interestassociated with the patient thereby enabling the user to view theportion field of view simultaneously as the detector is capturing theimaging field of view; a filter configured to filter image data of theimaging field of view of the target of interest as captured by thedetector to image data that is within a first frequency spectrum; and acomputing device configured to: select a portion field of view levelfrom a plurality of portion field of view levels that the image data isto be filtered from the imaging field of view of the target of interestassociated with the patient that is within the selected field of viewlevel, filter image data from the imaging field of view of the target ofinterest associated with the patient that is included in the selectedportion field of view level as the detector captures the imaging fieldof view of the target of interest associated with the patient inreal-time, adjust the imaging field of view of the target of interestassociated with the patient as captured by the detector in real-time tothe selected portion field of view level of the target of interestassociated with the patient thereby adjusting the image data that isfiltered from the imaging field of view of the target of interestassociated with the patient to that is within the selected portion fieldof view level as displayed to the user by the wearable display based onthe filtered image data as included in the selected portion field ofview level, and instruct the wearable display to display in real-time tothe user the selected portion field of view level based on the filteredimage data simultaneously as the detector is capturing the imaging fieldof view as the user engages the target of interest associated with thepatient, wherein the selected portion field of view level that isthereby displayed to the user by the wearable display is less than thetotal field of view of the user.
 2. The system of claim 1, wherein thecomputing device is further configured to: filter image data from theimaging field of view of the target of interest that is within a zoomlevel associated with a zoom field of view, wherein the zoom levelindicates the image data that is to be filtered from the imaging fieldof view to generate the zoom field of view that encompasses image datathat is within the zoom level; adjust the imaging field of view of thetarget of interest as captured by the detector to the zoom level fieldof view of the target of interest based on the filtered image data thatis within the zoom level; and instruct the wearable display to displayto the user the zoom level field of view that is thereby displayed tothe user by the wearable display, wherein the zoom level field of viewis less than the imaging field of view of the detector.
 3. The system ofclaim 2, wherein the computing device is further configured to: select azoom level from a plurality of zoom levels that image data is to befiltered from the imaging field of view of the target of interest thatis within the selected zoom level; and adjust the zoom level to theselected zoom level thereby adjusting the image data that is filteredfrom the imaging field of view of the target of interest that is withinthe selected zoom level.
 4. The system of claim 1, wherein the computingdevice is further configured to: filter image data from the imagingfield of view of the target of interest that is within a resolutionassociated with a resolution field of view, wherein the resolutionindicates the image data is to be filtered from the imaging field ofview to generate the resolution field of view that encompasses imagedata that is within the resolution; adjust the imaging field of view ofthe target of interest as captured by the detector to the resolutionfield of view of the target of interest based on the filtered image datathat is within the resolution; and instruct the wearable display todisplay to the user the resolution field of view that is therebydisplayed to the user by the wearable display, wherein the resolutionfield of view is less than the imaging field of view of the detector. 5.The system of claim 4, wherein the computing device is furtherconfigured to: select a resolution from a plurality of resolutions thatimage data is to be filtered from the imaging field of view of thetarget of interest that is within the selected resolution; and adjustthe resolution to the selected resolutions, thereby adjusting the imagedata that is filtered from the imaging field of view of the target ofinterest that is within the selected resolution.
 6. The system of claim1, wherein the computing device is further configured to: filter imagedata from the imaging field of view of the target of interest that iswithin a working distance associated with a working distance field ofview, wherein the working distance indicates the image data that is tobe filtered from the imaging field of view to generate the workingdistance field of view that encompasses image data that is within theworking distance; adjust the imaging field of view of the target ofinterest as captured by the detector to the working distance field ofview of the target of interest based on the filtered image data that iswithin the working distance; and instruct the wearable display todisplay to the user the working distance field of view that is therebydisplayed to the user by the wearable display, wherein the workingdistance field of view is less than the imaging field of view of thedetector.
 7. The system of claim 6, wherein the computing device isfurther configured to: select a working distance from a plurality ofworking distances that image data is to be filtered from the imagingfield of view of the target of interest that is within the selectedworking distance; and adjust the working distance to the selectedworking distance thereby adjusting the image data that is filtered fromthe imaging field of view of the target of interest that is within theselected working distance.
 8. The system of claim 1, wherein thedetector is further configured to: capture image data from the imagingfield of view of the target of interest that is within the firstfrequency spectrum as filtered by the filter.
 9. The system of claim 8,wherein the first frequency spectrum is a near infrared frequency. 10.The system of claim 1, further comprising: a light source that includesa plurality of individual light sources with each individual lightsource spaced a part from each other individual light source and isconfigured to project light onto the target of interest and prevent ashadow cast by an intervening object onto the target of interest due tothe spacing of the individual light sources.
 11. The system of claim 10,further comprising: a plurality of Light Emitting Diodes (LEDs) as theplurality of light sources with each LED spaced apart from each otherindividual light source and is configured to emit white light; and aspectral filter that is positioned so that the white light emitted bythe LEDs is propagated through the spectral filter and is configured toblock a wavelength of an emission spectra that the image is to bedisplayed to the user to prevent the white light emitted by the LEDsfrom interfering with an observance of the emitted wavelength by theuser as the image is displayed to the user.
 12. The system of claim 1,wherein the detector is a three-dimensional camera.
 13. The system ofclaim 1, further comprising: a peripheral interface configured tocommunicate with at least one peripheral, wherein the at least oneperipheral is a robot.
 14. A system for capturing images of a target ofinterest associated with a patient in real-time and simultaneouslydisplaying the captured images in real-time to a user that is engagingthe target of interest associated with the patient, comprising: awearable display that is worn on a head of the user as the user engagesthe target of interest associated with the patient and is configured todisplay in real-time a zoom level associated with a zoom field of viewto the user as the user engages the target of interest associated withthe patient via the wearable display simultaneously as images of thetarget of interest associated with the patient are captured and streamedin real-time to the wearable display, wherein the zoom level associatedwith the zoom field of view that is thereby displayed to the user by thewearable display is less than a total field of view of the user; adetector that is coupled to the wearable display and is configured tocapture an imaging field of view of the target of interest associatedwith the patient in real-time as the user engages the target of interestassociated with the patient, wherein real-time is when the imaging fieldof view of the target of interest associated with the patient iscaptured as the user engages the target of interest associated with thepatient thereby enabling the user to view the zoom level associated withthe zoom field of view as the detector is capturing the imaging field ofview; a filter configured to filter image data of the imaging field ofview of the target of interest as captured by the detector to image datathat is within a first frequency spectrum, wherein the first frequencyspectrum includes color image data; and a computing device configuredto: filter the color image data from the imaging field of view of thetarget of interest that is within the zoom level associated with thezoom field of view, wherein the zoom level indicates the color imagedata that is to be filtered from the imaging field of view to generatethe zoom field of view that encompasses color image data that is withinthe zoom level; adjust the imaging field of view of the target ofinterest as captured by the detector to the zoom field of view of thetarget of interest based on the filtered color image data that is withinthe zoom level; and instruct the wearable display to display to the userthe zoom level field of view that is thereby displayed to the user bythe wearable display, wherein the zoom level field of view is less thanthe imaging field of view of the detector.
 15. The system of claim 14,wherein the computing device is further configured to: select a zoomlevel from a plurality of zoom levels that image data is to be filteredfrom the imaging field of view of the target of interest that is withinthe selected zoom level; and adjust the zoom level to the selected zoomlevel thereby adjusting the image data that is filtered from the imagingfield of view of the target of interest that is within the selected zoomlevel.
 16. A system for capturing images of a target of interestassociated with a patient in real-time and simultaneously displaying thecaptured images in real-time to a user that is engaging the target ofinterest associated with the patient, comprising: a wearable displaythat is worn on a head of the user as the user engages the target ofinterest associated with the patient and is configured to display inreal-time a resolution associated with a resolution field of view to theuser as the user engages the target of interest associated with thepatient via the wearable display simultaneously as the images of thetarget of interest associated with the patient are captured and streamedin real-time to the wearable display, wherein the resolution associatedwith the resolution field of view that is thereby displayed to the userby the wearable display is less than a total field of view of the user;a detector that is coupled to the wearable display and is configured tocapture an imaging field of view of the target of interest associatedwith the patient in real-time as the user engages the target of interestassociated with the patient, wherein real-time is when the imaging fieldof view of the target of interest associated with the patient iscaptured as the user engages the target of interest associated with thepatient thereby enabling the user to view the resolution associated withthe resolution field of view as the detector is capturing the imagingfield of view; a filter configured to filter image data of the imagingfield of view of the target of interest as captured by the detector toimage data that is within a first frequency spectrum, wherein the firstfrequency spectrum includes fluorescence image data; and a computingdevice configured to: filter the fluorescence image data from theimaging field of view of the target of interest that is within aresolution associated with a resolution field of view, wherein theresolution indicates the fluorescence image data is to be filtered fromthe imaging field of view to generate the resolution field of view thatencompasses fluorescence image data that is within the resolution;adjust the imaging field of view of the target of interest as capturedby the detector to the resolution field of view of the target ofinterest based on the filtered fluorescence image data that is withinthe resolution; and instruct the wearable display to the user theresolution field of view that is thereby displayed to the user by thewearable display, wherein the resolution field of view is less than theimaging field of view of the detector.
 17. The system of claim 16,wherein the computing device is further configured to: select aresolution from a plurality of resolutions that image data is to befiltered from the imaging field of view of the target of interest thatis within the selected resolution; and adjust the resolution to theselected resolution thereby adjusting the image data that is filteredfrom the imaging field of view of the target of interest that is withinthe selected resolution.